Multimodal interaction with a virtual character in interactive storytelling
نویسندگان
چکیده
A number of interactive storytelling (IS) systems offer the user the possibility to input natural language input which determines how a story progresses. We introduce a framework for real-time signal processing (SSI) to analyze the users’ state which then can influence the feelings of the story characters and their actions in the story. SSI is not only used to enable more natural character responses that are sensitive to the user’s state at runtime. In addition SSI offers the possibility to collect a large variety of synchronized user data which can be used to analyze the user’s experience in offline mode. The underlying narrative in which the approach was tested is based on a classical XIX century psychological novel: Madame Bovary, by Flaubert.
منابع مشابه
Animated Interactive Fiction: Storytelling by a Conversational Virtual Actor
Personal use of this material is permitted. However, permission to reprinttrepublish this material for advertising or promotional purposes or for creating new collective w orks for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the IEEE. Abstract This paper presents an architecture for interactive storytelli...
متن کاملReal-Time Camera Control for Interactive Storytelling
In this paper, we present a fully implemented prototype of real-time cinematic control for character-based interactive storytelling approaches, where story diversity emerges from dynamic interaction between characters. We describe the specifities of real-time cinematic control within a dynamic virtual environment, where events occur at different locations at the same time. We also present resul...
متن کاملA Hybrid of Plot-Based and Character-Based Interactive Storytelling
Interactive storytelling in the virtual environment attracts a lot of research interests in recent years. Story plot and character are two most important elements of a story. Based on these two elements, currently there are two research directions: plot-based and character-based interactive storytelling. However, plot-based approach lacks the refinement of character behaviors as character-based...
متن کاملBalancing Narrative Control and Autonomy for Virtual Characters in a Game Scenario
We report on an effort to combine methods from storytelling and multimodal dialogue systems research to achieve flexible and immersive performances involving believable virtual characters conversing with human users. The trade-off between narrative control and character autonomy is exemplified in a game scenario.
متن کاملEmotional input for character-based interactive storytelling
In most Interactive Storytelling systems, user interaction is based on natural language communication with virtual agents, either through isolated utterances or through dialogue. Natural language communication is also an essential element of interactive narratives in which the user is supposed to impersonate one of the story’s characters. Whilst techniques for narrative generation and agent beh...
متن کامل